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Abstract 


Solvability  and  boundedness  criteria  for  dual  linear  programming 
problems  are  given  in  terms  of  the  problem  data  and  the  intersections  of 
the  nonnegative  orthant  with  certain  complementary  orthogonal  subspaces. 

Introduction 

The  duality  theorem  of  linear  programming  —  ^  relates  two  linear 
extremum  problems  in  terms  of  solvability,  boundedness  and  equality 
of  functional  values.  The  classical  theory  of  Lagrange  multipliers  admits 
extensions  to  some  special  nonlinear  cases  — ^  as  well  as  interpretations 
of  duality  in  the  context  of  applications.  —  ^ 

Tucker,  in  [l6],  showed  duality- -in  the  linear  case--  to  follow  from 
elementary  geometric  considerations  of  complementary  orthogonality  of 
manifolds  corresponding  to  the  dual  problems.  — ^ 

In  this  paper  we  follow  Tucker's  approach  and  supplement  his  results, 
in  [16  ] ,  by  an  alternative  theorem  for  dual  programs,  theorem  4  below, 
and  by  a  characterization  of  all  duality  situations  in  terms  of  the  geomet¬ 
rical  configurations  of  certain  manifolds  associated  with  the  data  and  the 
data  itself,  theorem  6  below. 

None  of  our  results  seem  to  be  essentially  new;  yet  our  efforts  may 
be  justified  for  pedagogical  reasons. 


y  Conjectured  by  Von  Neumann  (e.  g.  [7],  p.  23)  and  proved  by  Gale, 

Kuhn  and  Tucker  [3],  For  the  extended  form  discussed  here,  see 
Charnes  and  Cooper  [3]. 

2 /  Notably  Kuhn  and  Tucker  [ll] 

3/  E.  g.  [7],  pp.  19-Z2. 

4/  A  similar  approach  was  used  in  [l]  to  develop,  in  a  unified  manner,  the 
main  theorems  of  linear  inequalities. 
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0_._  Notations 

In  this  note  we  use  the  same  notations  as  in  £  1  j .  Recall  in  particular  that: 
A  is  an  arbitrary  ordered  field 

En  is  the  n-dimensional  vector  space  over 

C{f^, . . .  ,  f^}  is  the  cone  spanned  by  the  vectors  f^, . . . ,  in  En 
A  is  an  mxn  matrix  over  h 

N(A)  is  the  null  space  of  A  in  En 

T  T  n 

R(A  )  is  the  range  space  of  A  in  E  . 

In  addition  let  A+  denote  the  generalized  inverse  of  A  ,  e.  g.  [14]  and  [2]  . 

1.  Lemma:  Let  L  be  an  arbitrary  subspace  of  En,  Then  the  following 
are  equivalent: 

(i)  {x+L)(lEj  *<j>  for  all  x(En 

(ii)  L  f!  int  E™  i  <> 

(iii)  {x  +  L}  fl  int  E^1  ^  c \>  for  all  x  c  En 

Proof: 

<i)  =>  (ii) 

Suppose  (ii)  is  false.  This  is  possible  only  in  two  cases: 

Case  A:  L()  bdry  E^  =  C{cj, ...»  e^}  1  <  p  <  n  -  dim  L 

Case  B:  LHeJ  =  {e} 

V/ e  will  now  show  (i)  to  be  false  by  producing,  in  each  case,  a  vector  xq 

such  that  {x  +  L}  f)  E^  =  4>  . 

o  T 

Case  A:  Let  xq  be  any  vector  in  L"^  0  int  C{-ep+^, . . . ,  -en)  ,  a  set 
which  is  nonempty  by  [l]  ,  corollary  5, 

Ca3e  B:  Let  xq  be  any  vector  in  L^~  f)lnt{-E^}  ;  the  latter  set  is 
nonempty  by  [l],  corollary  2. 
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(ii)  —  >  (iii) 

Let  i  c  L  (1  int  .  Then  for  all  x«  En  and  scalars  X.  satisfying 

lx.l 

X  >  max  - 

x.<  0  £. 


we  have: 


x  +  U  (  int 


(iii)  — >  (i)  Obvious 

n 

2.  Corollary:  Let  A  be  an  arbitrary  mxn  matrix  over  H  %  Then  the 
following  are  equivalent: 

(i)  Ax  =  b  ,  x  >  8  is  solvable  for  all  b  €  R(A) 

(ii)  Ax  =  0  ,  x  >  0  is  solvable 

(iii)  Ax  =  b  ,  x  >  0  is  solvable  for  all  b  c  R(A)  . 

Proof: 

The  solutions  of  Ax  =  b  ,  when  solvable,  form  the  manifold:  A+b  +  N(A)  , 
e.  g.  [  14 ]  •  Now  (i),  (  ii)  and  (iii)  are  the  corresponding  parts  in  lemma  1 
with  x  =  A+b  and  L  =  N(A)  . 

0 

3.  Corollary:  Let  A  be  an  arbitrary  mxn  matrix  over  ^  .  Then  the 

following  are  equivalent: 

T  n 

(i)  A  w  >  c  is  solvable  for  all  c«E 

T 

(ii)  A  w  >  0  is  solvable 

(iii)  A*w  >  c  is  solvable  for  all  c  «  En  . 

Proof:  In  lemma  1  let  L  =  R(A^ )  ,  x  =  -c  . 


G 
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4.  Theorem:  Let  A  be  an  arbitrary  mxn  matrix  over  >  .  Consider 

the  system  of  equations  and  inequalities: 


I) 

Ax  =  b  ,  x  >  0 

I') 

Ax  =  0  , 

II) 

aT  >  c 

A  w  = 

II') 

ATw  >  0 

Then: 

a)  I  is  solvable  for  all  b  «  R(A)  if  and  only  if  II*  does  not  have  solutions  w 

T 

with  nonnegative  nonzero  vectors  Aw. 

b)  II  is  solvable  for  all  c  t  En  if  and  only  if  I'  does  not  have  nonnegative 
nonzero  solutions. 

T 

c)  If  II'  ha3  solutions  w  with  A  w  >  0  then  I  is  solvable  if  and  only  if 

ATw  >  0  =>  (b.w)  >  0  . 

d)  If  I*  has  solutions  x  with  x  >  0  then  II  is  solvable  if  and  only  if 
Ax  =  0  ,  x  >  0  =>  (c,x)  <  0  . 


Proof: 

a)  By  corollary  2  it  follows  that  I  is  solvable  for  all  be  R(A)  if  and  only 
if  N(A)flintE^  t  4>  .  By  [l],  corollary  2 ,  the  latter  condition  is 
equivalent  to  R(A^)  (1  E^  =  {0}  . 

b)  By  corollary  3,  II  is  solvable  for  all  c  *  En  if  and  only  if 

T  n 

R(A  )  0  intE+  ^  •  This  is  equivalent,  by  [lj,  corollary  2,  to: 

N(A)  n  E*  =  {0}  . 

c)  This  is  the  well-known  Farkas'  lemma,  e.  g.  [  1 5 ]  . 

d)  This  is  theorem  1  in  Ky  Fan  [6]  . 

0 
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Remarks 

a)  Theorem  4  is  a  collection  of  classical  results  in  a  setup  which  is  com¬ 
pletely  analogous  to  "Fredholm's  Alternative"  theorem  for  linear 
equations,  [5],  Solvability  relations  between  linear  inequalities  and 
equations  were  studied  by  Motzkin  [  13  ] »  Kuhn  [lO]  and  generalized  by 
Ky  Fan  to  the  case  of  complex  norraed  linear  spaces  [6]  .  For  a  use 

of  Fredholm's  theorem  to  prove  the  main  theorems  of  linear  inequalities 
see  [l]  , 

b)  For  b  «  R(A),  part  c  can  be  rewritten  as  : 

T 

c')  If  b  €  R(A)  and  II  has  solutions  w  with  A  w  >  0  then  I  is  solvable 
if  and  only  if 

ATw  >  8  =>  (ATw  ,  A+b)  >  0 . 

This  follows  from  the  fact  that  AA+  is  the  perpendicular  projection 
on  R(A),  e.  g.  [  Z]  . 

5.  Let  A  be  an  arbitrary  mxn  matrix  over  7~  ,  b  t  Em  and  c  c  En  . 

Let 

S  =  {x  c  En  :  Ax  =  b,  x  >  0}  1  =  sup(c,  x) 

xcS 

T  =  {w  (  Em  :  AT w  >  c}  I_  =  inf  (b,  w) 

£  wfT 

The  duality  theorem  of  linear  programming  relate.,  the  problem  of  solving 
for  Ij ,  the  primal  problem,  to  that  of  solving  for  ,  the  dual  problem. 
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Thc  duality  theorem  states  indeed  that  there  are  four  mutually 
exclusive  oases: 


Case  A: 

s  *  $  .  T*4>.  \  =  L 

Case  B: 

S  =  4>  .  T  4  <{>  ,  I2  =  -' 

Case  C: 

S  i*  4>  ,  T  =  <j>  .  Ij  =  « 

Case  D: 

S  =  <j>  ,  T  =  $ 

Conjectured  by  Von  Neumann,  e.g.  [7],  p.  23,  and  proved  by  Gale,  Kuhn 
and  Tucker  [8],  this  theorem  was  extended  to  some  nonlinear  situations, 
the  most  general  being  that  of  Charnes,  Cooper  and  Kortanek  [4]. 

We  will  now  elaborate  on  the  four  cases  given  above.  In  terms  of 
the  data  }A,b,c}  ,  and  more  specifically  of  the  configurations  of  N(A)  and 
)  with  respect  to  E+  ,  we  give  below  conditions  for  the  attainment  of 
each  of  the  above  cases. 

6.  Theorem: 

Let  A  be  an  arbitrary  mxn  matrix  over  /  ,  bt  F{A)  in  Em  , 
c  «  En  and  let  S,  T,  Ij  and  be  as  above  .  Then  there  are  eight  mutually 
exclusive  cases,  tabulated  below: 


c 

0  2  + 

Z  w 

U.  J3 

c  c 


o  w 
V  A 


>  •• 

<  <«  < 


empty  non-empty 
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Proof: 

The  cases  1, ...»  8  are  clearly  mutually  exclusive.  In  each  case 
theorem  4  is  used  to  draw  the  conclusions  regarding  the  sets  S  and  T  . 

Then  the  duality  theorem  of  linear  programming  is  used  to  obtain  1^  and  • 

Remarks: 

a)  The  above  8  cases  can  be  visualized  geometrically  in  a  manner  which 

helps  to  clarify  the  concept  of  duality.  Thus  in  the  2-dimensional  case 

T 

where  A  is  a  1x2  matrix,  dim  R(A  )  =  dim  N(A)  =  1,  the  first  case  appears 
as  follows:  4 


The  other  cases  are  drawn  in  a  similar  manner.  Furthermore,  by  the 

"complementary  slackness"  property,  it  is  now  easy  to  identify  optimal 

points.  Thus  xQ  is  the  optimal  solution  of  the  primal  problem  and 
T 

a  =  A  wq  -  c  where  wq  is  the  optimal  solution  of  the  dual  problem,  e.  g. , 
Tucker  [16],  p.  15. 

b)  Theorem  6  combines  well-known  solvability  theorems,  e.  g. ,  Tucker  [16] 
and  Charnes- Cooper  [3],  p.  214,  and  the  duality  theorem  of  linear  program¬ 
ming  to  characterise  the  duality  situations  in  terms  of  the  data  {A,b,  c)  . 
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